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Abstract: Evidence-based practice (EBP) is integral in the health care system whether in developed 
or developing countries. Thus, all health professionals need to be trained in EBP. An EBP training 
program was conducted to health professionals in a developing country, the Philippines. The health 
professionals (medical doctors and allied health professionals [physical therapists and occupational 
therapists]) were working in hospitals in Manila, Philippines. The program aimed to build capacity 
in EBP in terms of knowledge and skills. The EBP training program was conducted as a 1-day 
face-to-face training. Pre- and post-test measures of EBP knowledge and skills were taken prior to 
and immediately after the 1-day training, using the Fresno test of evidence-based medicine for the 
medical doctors and the Adapted Fresno test for the allied health professionals. The EBP training 
program resulted in significant improvements in knowledge and skills for both the medical doctors 
(change in pre- and post-Fresno test measures, 95% confidence interval [CI]: 14.6-23.5; P<0.05) 
and the allied health professionals (change in pre- and post- Adapted Fresno test measures, 95% CI: 
32.7-38.5; P^0.05). The EBP training conducted amongst the health professionals is an effective 
and tested undertaking in introducing EBP in developing countries such as the Philippines. 
Keywords: continuing education, developing countries physical therapy, medicine, knowledge 
and skills 

Background 

Evidence-based practice (EBP) is denned as the integration of best research evidence, 
clinical expertise, and patient values. 1 The aim of using evidence-to-guide practice is 
to support effective practice by using evidence-based patient management strategies 
which are known to result in best patient care as shown by Schreiber and Stern. 2 Thus, 
the concepts of EBP, which include formulating a focused clinical question, search- 
ing and accessing the literature to identify the best research evidence, assessing the 
validity of the evidence (critical appraisal), and applying the evidence to actual patient 
scenarios, have been introduced and evaluated in the training of health professionals, 
particularly among medical doctors in developed countries. 3 4 

The application of EBP has been integral in the health system for several years now. 5 
Within the last decade, the focus of research was the review of evidence in the form 
of clinical guidelines, systematic reviews, meta-analyses, and evidence summaries to 
arrive at recommendations to guide health professionals in practice. 6 " 9 More recently, 
research has been in the implementation of these recommendations into practice. 10-12 
Strategies addressing barriers such as lack of knowledge and skills in EBP, lack of 
access, and local contextual barriers have been identified and tested amongst a range 
of health professionals in various workplace settings. 10-12 
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Whilst EBP activities have taken place in developed 
countries such as Australia, Canada, the UK, and the US, the 
principle of getting research evidence into practice is still in 
its infancy in developing countries. It has been recognized that 
EBP is relevant to developing countries particularly in order to 
maximize the use of scarce health resources (ensuring that no 
money is put to waste) and achieve effective patient outcomes 
(considering health and safety) and efficient health systems. 
These benefits can filter through to reducing poverty-related 
conditions and result in better health outcomes. 13-18 Whilst 
these benefits of using EBP principles in practice have been 
clearly established, the growth of EBP in developing countries 
has been slow. 19 Country-by-country variations require strate- 
gies tailored to the local context settings to facilitate the use 
of EBP. One of the most important and basic strategies is the 
provision of an EBP training in order to cultivate a culture 
of research and to build EBP capacity among health profes- 
sionals and organizations. 141718 

To address the gaps in the literature, a tailored EBP 
training program was developed for a group of health pro- 
fessionals in a developing country (the Philippines). The 
training program consisted of the fundamental five steps in 
EBP (asking the right question, acquiring, appraising, apply- 
ing, and assessing the evidence) and strategies addressing 
the local context needs (format and delivery of the training 
program, online support, and use of a recommendation 
checklist). 13,20 The training program has been tested in a 
randomized controlled trial (RCT; control group did not 
receive any intervention and was waitlisted for the training) 
and was found to be significantly effective in improving 
knowledge, skills, attitudes, and behavior to EBP after the 
training (immediate and 3 months post- training). 20 The EBP 
training program was identified as appropriate and relevant to 
be conducted in other groups of health professionals in 
the country in order to build capacity in EBP and improve 
knowledge and skills. Thus, this study was undertaken to 
assess the impact of the EBP training amongst other health 
professionals in the Philippines. 

Materials and methods 

Ethics 

Ethical approval was obtained from the University of Santo 
Tomas, College of Rehabilitation Sciences Research Ethics 
Committee. 

Study design 

We conducted a "before and after study" to evaluate the 
effectiveness of a 1-day, face-to-face EBP training program 



designed to improve knowledge and skills in EBP amongst 
health professionals. Pre-training assessments were under- 
taken on the scheduled date of training, before commencing 
with the lectures and activities. Immediately after the training, 
post-training knowledge and skills in EBP were measured. 

There was no need for an experimental study with a 
control group as a previous RCT by Dizon et al had reported 
that the EBP training program (conducted in this study) 
resulted in significant improvements in knowledge, skills, 
attitudes, and behavior as compared with a waitlist control 
group. Large improvement in knowledge and skills were 
reported in the RCT (effect size was 0.74 for pre-training to 
immediate post-training). 20 

Participants 

Health professionals working in hospitals in Manila were 
recruited to take part in this study. As there was limited 
funding to run the study, one government and one private 
hospital were included in the study. 

Study setting 

The EBP training was conducted in the hospitals' conference 
rooms where laptops and internet access were set up. 

Intervention 

The EBP training program is a 1-day face-to-face training in 
the form of lectures and practical sessions and using small 
group discussions to facilitate learning (Table SI). In addi- 
tion to face-to-face training, the program consists of a link to 
online support ( https://www.unisa.edu.au/Research/Sansom- 
Institute-for-Health-Research/Research-at-the-Sansom/ 
Research-Concentrations/ Allied-Health-Evidence/Ouality- 
Care/EBPPhil/ ) and an EBP Checklist (Table S2) provided 
to the health professionals as a "take home" strategy. These 
strategies were designed to promote the use of the knowledge 
and skills in EBP after the training. Details of the EBP train- 
ing intervention have been published previously. 13,20 

Outcome measures 

The Fresno test of competency was used to measure EBP 
knowledge and skills among medical doctors. The Fresno 
test consists of clinical scenarios where a focused question 
needs to be formulated, and the following identified: sources 
of evidence, best evidence to answer the question, validity 
of the evidence, applicability of the evidence, and questions 
related to some statistical interpretations. 21 The Fresno test 
has been reported to be valid and reliable in measuring these 
domains (intraclass correlation coefficient [ICC]: 0.76-0.98 
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with a Cronbach's a of 0.88). The test is scored using a grad- 
ing rubric, with a total of 17 questions and 212 points. 

The Adapted Fresno test (AFT) 22 was used to measure 
EBP knowledge and skills among the allied health profession- 
als (physical therapists and occupational therapists). The AFT 
was adapted from the Fresno Test in medicine and has been 
reported to have good psychometric properties, measuring 
knowledge and skills after undergoing EBP training. 22 

There are two versions of the test (different clinical 
scenarios for each test) and ICC scores for subtests were, 
version 1: ICC: 0.80-0.96; version 2: 0.68-0.94 and ICC for 
total scores were version 1: ICC: 0.96; version 2: ICC: 0.91. 
Internal consistency was acceptable (Cronbach's 0v=0.74). The 
test is scored using a grading rubric with a total of seven ques- 
tions and 150 points. We used version 1 for the pre-training 
assessment and version 2 for the post-training assessment. 

Both the Fresno Test and the AFT measure the health 
professionals' ability to formulate a question from a clini- 
cal scenario, identify appropriate search terms and relevant 
sources of evidence, identify the basis for assessment of meth- 
odological strengths of the evidence, and assessment of clini- 
cal relevance, applicability, and magnitude of effects. 21,22 

Data analysis 

Data was analyzed using SAS software (v9.2; SAS Institute, 
Cary, NC, USA). Descriptive statistics (measures of central 
tendency and variability) were computed as well as within 
group changes from pre- to post-training (median changes, 
95% confidence interval, and associated P- values) in knowl- 
edge and skills using either the Fresno test or the Adapted 
Fresno test. 

Results 

A total of 3 1 health professionals from two hospitals in Manila, 
the Philippines participated in the study. There were 14 medical 
doctors and 17 allied health professionals. Characteristics of 
the participants are presented in Tables 1 and 2. Most of the 
participants in the training were <30 years of age and had <5 
years of practice. Very few had been exposed to training in EBP 
(more medical doctors than allied health professionals). 

Knowledge and skills in EBP significantly improved from 
pre- to post-training, in both groups (Tables 3 and 4). The 
improvements were larger amongst the allied health profes- 
sionals compared with the medical doctors. 

Discussion 

In this study, we report on the effects of an EBP training pro- 
gram conducted among health professionals in the Philippines. 



Table I Characteristics of the participants (n=3 1 ) 



Characteristics n (%) 

Age (years) 

<30 23 (74%) 

30-39 4 (13%) 

40-49 0 (0%) 

50-59 3 (10%) 

60+ I (3%) 
Sex 

Female 1 5 (48%) 

Male 1 6 (52%) 
Years of practice 

<l 6(19%) 

14(45%) 

5-9 4(13%) 

10-14 2(6%) 

15-19 I (3%) 

20-24 2 (6%) 

25-29 I (3%) 

30-34 0 (0%) 

35-39 0 (0%) 

40+ I (3%) 
Affiliation 

Private hospital 1 7 (55%) 

Government hospital 14(45%) 
Type of health professional 

Medical doctors (5 medical consultants 1 4 (45%) 
and 9 medical residents) 

Allied health professionals (15 physical therapists 17 (55%) 
and 2 occupational therapist) 
EBP exposure 

With EBP exposure (workshops in EBP) 

Medical doctors 3(10%) 

Allied health professionals I (3%) 
No EBP exposure 

Medical doctors I I (35%) 

Allied health professionals 1 6 (52%) 
Abbreviation: EBP, evidence-based practice. 



The training resulted in improved capacity in EBP among 
the medical doctors and allied health professionals in terms 
of knowledge and skills. Our findings are similar to the find- 
ings of a previous work by one of the authors of this study. 20 
However, the previous study conducted the EBP training for 
only one group of health professionals (physical therapists). 
This current study tested the EBP training not only amongst 

Table 2 Demographic characteristics of the medical doctors and 
allied health professionals 

Participants Sex Age* (years) Years of 

practice* 

Medical doctors Females =7 28.5 (26.0-67.0) 3.0 (0.5-40.0) 

(n=l4) Males =7 

Allied health Females =8 25.0 (22.0-36.0) 2.0 (0.0-13.0) 

professionals (n= 1 7) Males =9 

Note: *Age and years of practice reported as median and range. 
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Table 3 Changes in EBP knowledge and skills of the medical 
doctors 



Knowledge and 


Median 


95% 


P-value 


skills in EBP (Fresno 


(range) 


confidence 




test of EBM) 




interval 




Pre-training 


34.5 (20.0-48.0) 


30.0-40.2 


<0.05* 


Post-training 


54.0 (38.0-79.0) 


46.0-61.8 




Change 


19.0 (0-38) 


14.6-23.5 





Notes: ^Statistically significant difference in pre- and post-training knowledge and 
skills; P-value S0.05. 

Abbreviations: EBM, evidence-based medicine; EBP, evidence-based practice. 



physical therapists, but also included medical doctors and 
occupational therapists, and similarly, had significant gains 
in EBP knowledge and skills. 

Our study population was composed of young health 
professionals as many health professionals, particularly 
allied health professionals, migrate to other countries as there 
are limited work opportunities in this country. The same 
demographic has been reported on in a survey and a RCT 
conducted by one of the authors of this study 20 23 As such, 
most of the health professionals in our study have been in 
practice for not more than 5 years. 

With the increased drive to introduce and use evidence in 
practice most especially in developing countries, our study 
provides useful information regarding potential strategies 
to commence EBP activities. It is widely recognized that 
developing countries lack research culture and are largely 
dependent on colleagues and textbooks for information 
regarding practice. 14-19 In a descriptive survey conducted 
among physical therapists in the Philippines, the most com- 
mon source of evidence and information informing their 
treatment decisions were recommendations from colleagues 
(particularly doctors) and undergraduate education (lectures 
and textbooks). 23 Evidence from tested research was not a 
common source of information among the physical therapists. 
To shift from this current practice culture to a more evidence- 
based culture is very challenging. Changing from usual 
practice behavior of asking colleagues and reading textbooks 



Table 4 Changes in EBP knowledge and skills of the allied health 
professionals 



Knowledge and skills 


Median 


95% P-value 


in EBP (Adapted 


(range) 


confidence 


Fresno test of EBP) 




interval 


Pre-training 


30.0 (5.0-37.0) 


22.6-3 1 .6 <0.05* 


Post-training 


66.0 (53.0-93.0) 


51.3-71.6 


Change 


39.0 (20.0-57.0) 


32.7-38.5 



Notes: ^Statistically significant difference in pre- and post-training knowledge and 
skills; P-value==0.05. 

Abbreviation: EBP, evidence-based practice. 



to searching for the current best research evidence in making 
decisions regarding a patient's case and goals takes time. 
Several barriers have been reported in undertaking behavior 
change in implementing principles of EBP such as individual 
constraints, lack of knowledge and skills in EBP, practice 
setting, lack of organizational support, and lack of time, 
amongst others. 20,24-26 Therefore, to address these barriers, 
careful planning and identification of effective strategies are 
critical. Michie et al identified several domains needing to 
be considered in implementing EBP. 27 Knowledge and skills 
are two of the domains needed to be addressed first, as these 
are a major barrier in EBP. Providing the health professionals 
with the fundamental knowledge and skills in EBP creates 
a clear understanding of the concepts of EBP (as oppose 
to hearing about the misconceptions regarding EBP) and 
presumably leads to a more positive attitude towards the use 
of EBP in practice. 27 

We recognize that whilst post-training knowledge and 
skills improved significantly amongst the health professionals 
in our study, training to improve knowledge and skills in EBP 
does not directly result in practicing in an evidence-based 
manner. Changing from current practice to an EBP man- 
ner requires more than just basic training. There are more 
domains of influence, such as beliefs about capabilities and 
consequences, motivation and goals, environmental context, 
and resources, amongst many others. 27 As there are quite a 
number of domains of influence, more strategies need to be 
undertaken and evaluated to fully adopt an EBP behavior. 

We also recognize that to fully adopt a culture of 
EBP, training should be integrated into the undergraduate 
curriculum. Currently, there are very few teachers in the 
Philippines equipped with the capacity to teach EBP amongst 
students in the health professions. Providing EBP training 
to health professionals is a strategic "train-the-trainer" 
approach. Building the capacity of the health professionals 
in EBP enables them to be future educators to undergraduate 
students in the health professions. 

Limitations 

The sampling frame and the limited funding did not allow us 
to include more health professionals in this study. 

Conclusion 

EBP training in our study resulted in significant gains 
in knowledge and skills among the health profession- 
als involved. The EBP training used in this study has 
the potential to be useful to various groups of health 
professionals. 
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Table SI Training outline 


Schedule 


Topic 


Strategy 


Participant's output 


Activities 








08:30-09:00 


Introduction to EBP 


Lecture 




09:00-09:45 


Hierarchy of evidence and study designs 


Lecture 




09:45-10:00 


Break 






10:00-10:30 


PICO formulation 


Lecture on drafting PICO 
Practical session on: 

a) Drafting PICO from a case 

b) Drafting own PICO 


Own PICO 


10:30-1 1:15 


Designing the search 


Lecture-demo 


Own search strategy 


1 1:15-12:00 


Conducting the search 


Practical session 


Acquire evidence 


12:00-01:30 


Lunch 






01:30-03:00 


Appraising the evidence 


Lecture 

Practical session 


Appraised paper 


03:00-03:15 


Break 






03:15-04:30 


What does the evidence say and how 
applicable is it? 

How can it be applied using the EBP checklist? 


Lecture 

Practical session 


Answer to own PICO 


04:30-05:00 


Post-program knowledge, skills, and attitudes 
assessment 


Adapted Fresno test and answer 
evaluation questions 





Notes: PICO, patient problem or population (P), intervention (I), comparison (C) and outcome(s) (O). 
Abbreviation: EBP, evidence-based practice. 

Table S2 EBP Checklist 



Recommendation for applying the findings 



Clinical relevance or applicability 

• Is the population similar to your patient case and values? 

• Was the intervention described in detail for you to replicate? 

• Do you have the skills and facilities (equipment/venue) to apply the intervention? 
Validity of the evidence-base 

• Is the study valid based on the results of the appraisal? 

• Were outcome measures valid? 

• Were other relevant factors considered? 
Magnitude of effects or clinical impact 

• Are findings clinically significant? 

• What are the expected effects? 
Applicability 

Based on the clinical relevance, validity, and magnitude of effects, are you confident 
in applying the findings to your own patient? 
Barriers to applying the evidence 

Given that the findings are clinically relevant, valid, and that expected effects are 
reproducible and applicable, what would make it difficult for you to apply the 
findings to your patient? 

Strategies to address barriers 

What are your suggestions to address the barriers? (please identify realistic 
and doable strategies) 



Yes 



Yes 



Yes 



Yes 



List potential barriers 

I. 

2. 

3. 

4 

List possible strategies 

I. 

2. 

3. 

4. 



No 



No 



No 



No 
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